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Abstract 

We give an effective procedure that produces a natural number in 
its output from any natural number in its input, that is, it computes a 
total function. The elementary operations of the procedure are Turing- 
computable. The procedure has a second input which can contain the 
Godel number of any Turing-computable total function whose range 
is a subset of the set of the Godel numbers of all Turing-computable 
total functions. We prove that the second input cannot be set to the 
Godel number of any Turing-computable function that computes the 
output from any natural number in its first input. In this sense, there 
is no Turing program that computes the output from its first input. 
The procedure is used to define creative procedures which compute 
functions that are not Turing-computable. We argue that creative 
procedures model an aspect of reasoning that cannot be modeled by 
Turing machines. 



1 Introduction 



There are doubts whether Turing machines can capture all reasoning pro- 
cesses. For example, Turing [l939|. pp. 200, 215] writes: 

Godel's theorem shows that such a system [intellectually satisfy- 
ing system of logical inference] cannot be wholly mechanical ... 

*This work is licensed under the Creative Commons Attribution- NonCommercial- 
NoDerivs 3.0 Unported License (see ||http: / /creativecommons.org/licenses/by-nc-nd/3.0/[ ). 
^Correspondence to p.k.ammon [at] cproc [period] org. Comments are welcome. 
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The necessity for using the intuition is then [by the introduction 
of a formal logic] greatly reduced by setting down formal rules 
for carrying out inferences which are intuitively valid. ... In pre- 
Godel times it was thought by some that it would probably be 
possible to carry this programme to such a point that all the in- 
tuitive judgments of mathematics could be replaced by a finite 
number of these rules. The necessity for intuition would then be 
entirely eliminated. 

Thus, Turing |l939] interprets Godel's theorem in the sense that an "intellec- 
tually satisfying system of logical inference ... cannot be wholly mechanical" 
and "all the intuitive judgments of mathematics" cannot "be replaced by a 
finite number of these rules" , that is, "formal rules for carrying out inferences 
which are intuitively valid". 

Turing [1936, p. 23l] restricts his machines to a finite number of re- 
configurations (machine configurations) which are called "states of mind" in 
his [1936, pp. 249-250] substantiation of the thesis that his machines can 
compute "all numbers which would naturally be regarded as computable" 
(Turing's thesis). Turing [T9361 pp. 249-250] supposes that the "number of 
states of mind" is finite because some of them "will be confused" if "we ad- 
mitted an infinity of states of mind" (see Kleene Il952[ pp. 376-377]). Godel 
jl990[ p. 306] regards the restriction to a finite number of states as a "philo- 
sophical error in Turing's work" and points out that "mental procedures" 
may "go beyond mechanical procedures". Godel [1900. p. 306] writes: 

What Turing disregards completely is the fact that mind, in its 
use, is not static, but constantly developing, ... There may exist 
systematic methods of actualizing this development, which could 
form part of the procedure. Therefore, although at each stage 
the number and precision of the abstract terms at our disposal 
may be finite, both (and, therefore, also Turing's number of dis- 
tinguishable states of mind) may converge toward infinity in the 
course of the application of the procedure. 

Thus, Godel discusses the possible existence of "mental" procedures that 
cannot be modeled by any Turing machine which is restricted to a finite 
number of "states of mind" in Turing's Il936[ pp. 249-250] substantiation of 
his thesis. 

Referring to his own form of Godel's incompleteness theorem, Post |l944[ 
p. 295] writes: 
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The conclusion is unescapable that even for such a fixed, well de- 
fined body of mathematical propositions, mathematical thinking 
is, and must remain, essentially creative. 

Godel's [1965a, p. 5] incompleteness theorem is based on "Principia Mathe- 
matica and related systems". Referring to his result that there is no finite 
method deciding whether a sequence is generated by the operations of a 
normal system Post Il965al pp. 407-408] writes: 

... the analysis ... is fundamentally weak in its reliance on the 
logic of Principia Mathematica ... But for full generality a com- 
plete analysis would have to be made of all possible ways in which 
the human mind could set up finite processes for generating se- 
quences. 

Davis [1982b, p. 21] writes that Post "evidently felt that the very incom- 
pleteness of 'Principia Mathematica' ... undermined its suitability as a basis 
for such an analysis." 

Turing's, Godel's and Post's remarks suggest the possible existence of 
"mental" procedures that cannot be reduced to Turing machines. Section [2] 
introduces an effective procedure that computes a total function. We prove 
that a second input of the procedure cannot be set to the Godel number of 
any Turing program that computes the output from any natural number in 
its first input. The procedure concerns the question whether every proce- 
dure used in an "intelligent" system can be modeled by a Turing machine. 
In particular, it concerns the question whether an "intelligent" system can 
model all its own functions by a Turing machine. 

Section [3] uses the procedure in Section [2] to define creative procedures 
which compute functions that are not Turing- computable. We argue that 
creative procedures capture an aspect of Godel's "mental procedures" which 
are not Turing-computable. In Section H] we discuss Church's thesis. 

2 Procedure 

For his own form of Godel's incompleteness theorem Post [T944] introduced 
creative sets whose definition implicitly refers to productive functions^ We 

lr The term productive is due to Dekker 1 19551 . 
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regard the existence of productive functions as a key to the phenomenon of 
incompleteness. 

We deal with natural numbers, sets of natural numbers, and functions 
from natural numbers to natural numbers. We use the following terminology 
and notations: We write domain tp for the domain of a function <p and range ip 
for the range of (p. A function is called partial if its domain is a subset of 
the set all natural numbers. A function is called total if its domain is the set 
of all natural numbers. If ip is a partial function of natural numbers, we say 
that ip is defined at the natural number x if x G domain tp. 

Because Turing machines are represented as finite sets of instructions, 
that is, as finite sequences of a fixed finite number of symbols, it is possible 
to list the sets of instructions of all Turing machines by an algorithm, for 
example, in ascending length according to the number of symbols that a set 
of instructions contains. We follow Rogers [1987, p. 21] and keep such a 
listing fixed for the remainder of this article: 

Definition 1. The Turing program Pi is the set of instructions of a Turing 
machine associated with the natural number % in a fixed listing of the sets of 
instructions of all Turing machines, i is called the index or Godel number of 
Pi. ipi is the partial function determined by Pi. i is also called the index or 
Godel number of ipi. 

The listing gives an algorithm for generating P, from any natural number 
i and another algorithm for generating a natural number % from the set of 
instructions P of any Turing machine such that P is Pi. The two algorithms 
can be encoded as ordinary computer programs. 

A set of natural numbers is recursively enumerable if there is an algorithm 
for enumerating its members. A precise definition is [Rogers, 1987 p. 58]: 



Definition 2. A set of natural numbers is recursively enumerable if it is 
empty or the range of a Turing-computable total function. 

A set is called productive if there is a mechanical procedure (algorithm) 
which, given any recursively enumerable subset, produces a member of the 
set that is not contained in the given subset. A precise definition is: 

Definition 3. A set S of natural numbers is productive if there is a Turing- 
computable partial function ip such that, given any total function (pj whose 
range is a subset of S, the value ip(J) is defined and contained in S but not 
in the range of tpf 
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(yj)[<Pj total & range fj C S 4 

[ip{j) defined & ip(j) G S — rangetpj}} 

The partial function ip is called a productive partial function for S. 

Definition [3] is equivalent to the definition of productive sets in Rogers 
[19871 P- 84, see p. 90] because of basic theorems such as Rogers [19S7J P- 60, 
Theorem V, and p. 61, Corollary V(b)]. 

The following theorem states that the set {i\(pi total} of the Godel num- 
bers i of all (Turing-computable) total functions <pi is productive. According 
to Definition [31 this means that there is a Turing-computable partial func- 
tion if), which is called productive, such that, given any (Turing-computable) 
total function <pj with range (pj C {i\ipi total}, the value ip{j) is defined and 
contained in {i\(pt total} but not in the range of (pj. 

Theorem 1. The set {i\<Pi total} of the Godel numbers i of all total functions 
<fi is productive. 

Proof. Let j be any natural number such that tpj is a total function with 
range (pj C {i\ipi total}, that is, the range of ipj is a set of Godel numbers 
of Turing-computable total functions. Thus, < Pi Pj ( n ) is a Turing-computable 
total function for any natural number n. Using Cantor's diagonal method 
we define a new function Sj by 

5j{n) = ¥> w (n)(n) + l (1) 

for all natural numbers n. Obviously, Sj is a total function because ip^ .ua is 
a total function for any natural number n. 

In order to prove the theorem, we construct a Turing-computable proce- 
dure computing a partial function ip whose input is any natural number j 
satisfying the properties that <pj is a total and range ipj C {i\ipi total}. Such 
a natural number j is given at the beginning of the proof and is used in the 
definition of the function 5j in ([T|). The output ip(j) of the function ip for 
the input j is the Godel number ip(j) of a Turing program P^(j) computing 
the function 5j in ([T]). The Godel number ip(J) is constructed as follows: 
According to Definition [U the function (fj in is computed by the Tur- 
ing program Pj and the function <p Vj ( n ) in CQ) is computed by the Turing 
program P Vj ( n )- The expression </? w ( n )(n) + 1 in ([T]) can be regarded as a 
pseudo-code for a Turing program Pmj) which computes the function Sj in 
([I]) and can be constructed from the Turing programs Pj and P V] ( n ), where 
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(Pj(n) is the result of applying Pj to n. The construction of -P^O) fr° m Pj 
and P v j n ) can be achieved by a Turing-computable procedure that is inde- 
pendent of the Godel number j because the states of Pj and P Vj ( n ) (called 
m-configurations, that is, machine configurations, in Turing Il936l and in- 
ternal states in Rogers 119871 p. 13]) can be renamed such that Pj and P Vj { n ) 
only contain different states and can thus be used as components of P${j\. 
Because of Definition [Q the Godel number if)(j) of P^(j) can be generated 
from P^(j) by a Turing-computable procedure. From the Turing-computable 
procedures producing ip(j) from P^{j) and P^(j) from Pj and Pip^n) we can 
construct a Turing-computable procedure that computes ip(j) from the Godel 
number j of any total function tpj with rangetpj C {i\tpi total}. Therefore, 
ip is a Turing-computable partial function that computes the Godel number 
of a Turing program P^(j) computing the total function Sj from the 
Godel number j of any total function ifj with range tpj C {i\(pi total} which 
was given at the beginning of the proof. 

Because of ([1]) the function Sj is different from <^v?j(™) f° r a ^ natural num- 
bers n. Because the Turing program P^(j), which computes ip^u) according 
to Definition [fl also computes the function Sj in (OQ), Sj(n) = (p^u){n) for 
all natural numbers n. Therefore, the total function <£ty(i) is different from 
</V(n) f° r an natural numbers n. In particular, if)(J) is different from fj{n) 
for all natural numbers n because different functions V^VO) anc ^ PpM cannot 
have the same Godel number according to Definition [TJ This implies that 
is not contained in range ipj, that is, the range of tpj. 

Therefore, ip is a productive partial function for the set {i\(fitotal} of 
the Godel numbers i of all total functions In view of Definition [3] this 
completes the proof of the theorem. 

□ 

Rogers [1987, p. 84, Example 2] suggests another proof that the set 
{i\(fi total} is productive. 

Definition 4. A recursively enumerable set S of natural numbers is creative 
if its complement is productive. 

Referring to Godel's |l965aj incompleteness theorem, Rogers |jl987[ pp. 
97-98] states that [the Godel numbers of] the provable well-formed formulas of 
Peano arithmetic form a creative set, [the Godel numbers of] the unprovable 
well-formed formulas form a productive set, and [the Godel numbers of] the 



6 



true well-formed formulas of elementary arithmetic form a productive set. 
Rogers \TW7l p. 98] writes: 



... no axiomatization of mathematics can exactly capture all true 
statements in elementary arithmetic; and from any axiomatiza- 
tion which yields only true statements in elementary arithmetic, 
a new true statement can be found not provable in that axioma- 
tization. 

... Post believed that such facts manifest an essentially creative 
quality of mathematics; hence the name creative set. 

Soare |l978[ p. 1151] writes: 

Such r.e. [recursively enumerable] sets were called creative by Post 
... because their existence ... implies the impossibility of mechan- 
ically listing all statements true in such a fragment [fragment of 
mathematics as elementary number theory]. 

The construction of undecidable formulas of formal systems in Godel's 
Il965al incompleteness theorem can be represented by an algorithm. Produc- 
tive functions (see Definition [3]) , which are Turing-computable, correspond 
to a formal abstraction of this algorithm. Thus, the input of productive func- 
tions corresponds to formal systems. This suggests that formal systems, in 
particular, Turing programs, cannot refer to themselves, that is, they cannot 
capture their own existence. Otherwise, the application of productive func- 
tions, which correspond to the construction of the undecidable propositions, 
could be used to "overcome" incompleteness as described below. 

We use any productive function ip for the set of the Godel numbers of 
all Turing-computable total functions in Theorem [TJ to define a procedure Q 
which computes the output u{x) of a total function u for any natural number 
x in its input and prove that function u is not Turing-computable. The 
procedure Q has a second input j which is in the domain of ip and contains the 
Godel number of a Turing program representing an existing formal system. 
The function u is not Turing-computable because Godel numbers where 
j is an existing Godel number in the domain of ip, are contained in the output 
of the procedure Q, that is, the output of uj. Roughly speaking, there is no 
Godel number j of a Turing program Pj generating all Godel numbers of 
Turing-computable total functions that a human (or a "machine" ) generates 
if the human (or the "machine") applies ip to the existing Godel number 
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I := least {n G N | n ^ domain a}; 
if is-set (j) 



then a :— a U {(I, 
if is-not-set (x) 



then return 1 ; 
if x G domain a 



then return a(x); 
a := a U {(x, c)}; 
return a(x); 



Table 1: Procedure Q with two inputs x and j and a global variable a for 
computing u(x) 

j and thus produces the Godel number ip(j) of a Turing-computable total 
function that is not generated by Pj. 

Definition 5. The procedure Q, whose pseudo-code is given in Tabled], has 
two input variables x and j. The variable x is not set or set to any natural 
number, that is, x has no value or the value of x is any natural number. The 
variable j is not set or set to the Godel number of any Turing-computable 
total function whose range is a subset of the set {i\<fi total} of the Godel 
numbers i of all total functions ipi. 

The global variable a in the procedure Q in Table [T]is set to the empty set 
before the first execution of the procedure Q. The variable a is a function 
which is represented as a set of input-output pairs (x,y), that is, (x,y) G a 
means a(x) = y in ordinary notation. The variable a is only changed by the 
procedure Q itself. 

The first line of the procedure Q in Tabled] sets the variable / to the least 
natural number n G N that is not contained in the domain of the function a 
which was set to the empty set before the first execution of the procedure 
Q. The function ip in the third line of the procedure Q is a productive 
partial function for the productive set {i\fi total} of the Godel numbers i of 
all total functions Such a productive partial function ip exists according 
to Theorem [1] (see Definition [3]). If the second input variable j is set (has a 
value), that is, the condition in the second line of the procedure Q is satisfied, 
the third line adds the input-output pair (/, to the function a, which is 
represented as a set of input-output pairs. If the first input variable x is not 
set (has no value), that is, the condition in the fourth line of Q is satisfied, 
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the fifth line returns 1 as the output of the procedure Q. If the condition 
x G domain a in the sixth line is satisfied, the procedure Q returns a(x) as its 
output in the seventh line. Otherwise, the eighth line adds the input-output 
pair (x, c) to the function a, where the constant c is the Godel number of any 
fixed Turing-computable total function. Finally, the ninth line returns a(x), 
which is equal to c because of the eighth line, as the output of the procedure 
Q. 

Theorem 2. All elementary operations of the procedure Q in Definition [5] 
and Table [TJ are Turing-computable. 

Proof. The least natural number n G N that is not contained in the domain 
of the function a in the first line in Table [TJ is Turing-computable because a 
is a finite set of input-output pairs at every point in time. The expression 
ip(j) in the second line in Table [TJ is Turing-computable because j is the 
Godel number of any Turing-computable total function whose range is a 
subset of the set {i\<Pi total} of the Godel numbers i of all total functions ifi 
according to Definition j is in the domain of tp according to Definition [3J 
and Theorem [JJ and ip is Turing-computable according to Definition [3J and 
Theorem [TJ Obviously, the other elementary operations in the procedure Q 
are also Turing-computable. □ 

Theorem 3. The procedure Q in Definition [5] and Table [TJ computes a total 
function whose input is any natural number x in the first input of Q and 
whose output is the output of Q, where the second input variable j of Q is 
not set or set and may be changed at any time according to Definition [5j 

Proof. The value a(x), where x is any natural number, in the seventh and the 
ninth line in Table [JJis uniquely determined by the set a of input-output pairs 
representing the function a: Let x, yi, and y 2 be any natural numbers with 
(x,yi) G a and (x,y 2 ) G a. This implies yi = y 2 because of the construction 
of a in the first and the third line and the extension of a in the eighth line 
is only used if x ^ domain a. Thus, the value a(x) is uniquely determined. 
Therefore, the value uj(x) is uniquely determined because uj{x) = a(x) for 
any natural number x G domain a. 

The procedure Q in Table [TJ computes the value u(x) of the function uj 
for any natural number x because the input-output pair (x, c) is added to 
a in the eighth line if x ^ domain a. Therefore, the domain of the function 
oo, which is computed by the procedure Q, is the set of all natural numbers, 
that is, uj is a total function. □ 
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Definition 6. We write u for the total function computed by the procedure 
Q according to Theorems H] and [3J 



Theorem 4. The range of the total function u in Definition is a subset of 
the set {i\tpi total} of all Turing-computable total functions. 

Proof. According to Definition [5] the second input j of the procedure Q in 
Tabled] is not set or set to the Godel number of any Turing-computable total 
function whose range is a subset of {i\<Pi total}. Thus, the value in the 
third step of Q is the Godel number of a Turing-computable total function. 
In the third step of Q, the value is used as an output of the function a. 
According to Definition [5l the value c in the eighth step of Q is the Godel 
number of a fixed Turing-computable total function. In the eighth step of 
Q, the value c is used as an output of the function a. Thus, the range of 
a is a subset of {i\<fi total} . This implies that range of w is a subset of 
total} because any member in the range of u is contained in the range 
of a according to the seventh and the ninth step of Q. □ 

The following examples illustrate the computation of the function uj by 
the procedure Q. 

Example 1. According to Definition [5]the global variable a in the procedure 
Q in Table [1] is set to the empty set before the first execution of the 
procedure Q. 

In order to compute, for example, the output oj(1) of the input 1 we apply 
the procedure Q to the value 1 of its first input variable x. According to the 
eighth line in Table [TJ the input-output pair (1, c) is added to the function a 
which is represented as a set of input-output pairs. According to the ninth 
line in Table (TJ the procedure Q returns 



as the output uj(1) of the input 1. 

In order to compute the output a; (5) of the input 5 we apply the procedure 
Q to the value 5 of its first input variable x. Thus, the input-output pair 
(5, c) is added to the function a and the procedure Q returns 



= a(l) = c 



(2) 



to (5) = a(5) = c 



(3) 



as the output u(5) of the input 5. 
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Let ji be the Godel number of any Turing-computable total function ipj 1 
whose range is a subset of {i\fi total}. We apply the procedure Q to the 
value ji of its second input variable j. Because the value of j is set, the third 
line in Tabled] adds the input-output pair (2, V'(ji)) to the function a, where 
2 = least {n G N | n ^ domain a} according to the first line in Table [TJ 

In order to compute the output ui{2) of the input 2 we apply the procedure 
Q to the value 2 of its first input variable x. Because 2 G domain a, the 
procedure Q returns 

u(2) = a(2) = ^O'l) (4) 
as the output ou(2) of the input 2 according to the seventh line in Table [TJ 

Example 2. We set the global variable a in the procedure Q in Table [JJ to 
the empty set before the first execution of Q. 

Let j\ be the Godel number of any Turing-computable total function (p^ 
whose range is a subset of {i\(pi total}. We apply the procedure Q to the 
value ji of its second input variable j. Thus, the third line in Table [TJ adds 
the input-output pair (1, V'(ji)) to the function a, where 1 is the least natural 
number that is not contained in the domain of a according to the first line 
in Table [TJ Then, the computation of the output w(l) yields 

w (l) = a(l)=V0*i)- ( 5 ) 

We construct a sequence of Godel numbers js, ... of Turing-computable 
total functions <pj 3 , ... as follows: Let k > 1 be any natural number. We 
define a function ipj k by <fj k (l) = ip(jk-i) and 

Vhi x ) = <Pjk-i( x - !) ( 6 ) 

for all natural numbers x > 1. Thus, the range of tpj k contains ip(jk-i) and 
( Pjk-ii x ) ^ or an y na t ura l number x. Obviously, ipj k is a Turing-computable 
total function whose range is a subset of {z|y?i total}. 

The application the procedure Q to the value jk of its second input vari- 
able j adds the input-output pair (k,ip(jk)) to the function a. Therefore, the 
computation of the output u(k) yields 

u (k) = a(k) = VO'fc) (7) 

for any natural number k. 
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The procedure Q in Table [T] contains two input variables x and j. If Q 
is applied to any natural number x, Q produces an output u(x), that is, Q 
computes a total function. If u were Turing-computable, there would be a 
Turing program computing u. The proof of the following theorem shows that 
the input variable j of Q cannot be set to the Godel number of this Turing 
program, that is, Pj, because the productive function xjj in Q is applied to 
j and ip(j) is used in the output of uj such that Theorem [T] precludes that 
Pj computes u. The condition in the following theorem entails that ip{j) is 
in the output of the function uj according to the third line of the procedure 
Q. Therefore, the Turing program Pj does not compute u because is 
not contained in the output of Pj according to Theorem [TJ An explanation 
is that the Godel number can be used to construct a more powerful 
Turing program that produces and all Godel numbers in the output 
of Pj. Thus, Q can be used to construct more and more powerful Turing 
programs. 

Theorem 5. There is no Godel number j such that the Turing program 
Pj computes the total function u in Definition [6] if the procedure Q, which 
computes the function u according to Theorems [2] and [31 is applied to the 
Godel number j of the Turing program Pj in its second input. 

Proof. We assume that there is any natural number j such that the Turing 
program Pj computes the total function u in order to derive a contradiction. 
Our assumption implies that 

u(x)=<p j (x) (8) 

for all natural numbers x because Pj also computes (pj according to Definition 
[TJ According to the condition in the theorem to be proved we apply the 
procedure Q to the Godel number j of the Turing program Pj in its second 
input. Because the range of the function a; is a subset of {i\(f i total} according 
to Theorem HJ j is the Godel number of a Turing-computable total function 
whose range is a subset of total}, that is, j is an admissible input of 
the procedure Q in Definition Because the second input variable j of the 
procedure Q is set, that is, the condition in the second line of the procedure 
Q in Table [1] is satisfied, the third line adds the input-output pair (l,ip(j)) 
to the function a, that is, 

a(l) = (9) 
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where I = least {n e N | n ^ domain a} according to the first line in Tabled] 
Because of (J9J), £ £ domain a and 



This implies that ip(j) is contained in the range of the function (pj. According 
to Theorem [T] the value is not contained in the range of the function 
(fj. Thus, we have derived a contradiction from our original assumption that 
any Turing program Pj computes the total function u. Therefore, there is no 
Turing program Pj, where j is any natural number, that computes the total 
function oj. □ 

The condition "if the procedure Q ..." in Theorem can be implemented 
by the following if-then rule: 

Rule 1. If j is the Godel number of a Turing program Pj that computes a 
total function whose range is a subset of total}, then apply the procedure 
Q in Definition [5] to x and j, where the value of the input variable x is not 
set. 

If Rule [1] is applied, the condition "if the procedure Q ... in its second 
input" in Theorem [5] is satisfied. This implies that there is no Turing pro- 
gram Pj, where j is any natural number, computing the total function u in 
Definition 

The condition in Rule [1] may be modified. For example, the condition 
may require a formal proof that Pj "computes a total function whose range 
is a subset of {i\(pi total}." 

3 Discussion 

The proofs of Theorems El El HI and [5] in Section [2] constitute precise evidence 
that all elementary operations of the procedure Q in Table Q] are Turing- 
computable and the total function u, which is computed by the procedure 
Q, is not Turing-computable. The theorems are independent of the special 
productive function ip of the procedure Q in Table [Q, that is, Theorems [21 
[31 HI and [5] remain valid if the procedure Q in Table [H uses any productive 
function. This suggests the following definition: 



W (o = a (i) = m 

because of the seventh line in Table [TJ Because of ([HD , 

u(l) = (fj{l). 



(10) 



(11) 
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Definition 7. A procedure, whose elementary operations are computable 
by Turing programs, is called creative if it computes functions that are not 
computable by Turing programs. 

According to Theorems [2] and [3] the procedure Q computes the total func- 
tion uj in Definition E] which is not Turing-computable according to Theorem 
[5j This means that the procedure Q is creative in the sense of Definition [7J 

Rule [H in Section [2] provides Godel numbers j of Turing programs Pj 
that compute total functions whose range is a subset of {i\(pi total}, that 
is, existing information, in the input of the procedure Q but these Godel 
numbers j cannot completely be represented in Q because the set {i\<fi total} 
is productive. The procedure Q is creative according to Definition [7J because 
Q computes the function oj which is not Turing-computable. Thus, Rule [1] is 
an implementation of the following general principle for creative procedures: 

Existence Principle. Existing information, for example, Godel numbers of 
Turing programs, is provided in the input of procedures which are creative 
according to Definition [7J if the information cannot completely be represented 
in the procedure. 

The existence principle, in particular, Rule UJ can be implemented phys- 
ically, that is, in a "machine". Let 

m, (12) 

where j is any natural number, be formal propositions that stand for the 
condition "j is the Godel number of a Turing program Pj that computes a 
total function whose range is a subset of {i\(pi total}" in RuleHJ that is, L in 
(I12p refers to a fixed finite string. The formal proposition L(j) has a physical 
representation. Rule [1] is applied if the proposition L(j) in f JT2|) . in particular, 
the Godel number j, is generated physically. The existence principle simply 
implies that existing information, which is available physically, is provided 
in the input of creative procedures such as the procedure Q in Table [TJ In 
view of the results described previously, this means that the function u can 
neither be modeled by any Turing machine nor be dealt within a formal 
system although the computation of uj can be implemented physically, that 
is, in a "machine". 

The function a in the procedure Q represents the function uj in the sense 
that the input-output pairs in a are a finite subset of the input-output pairs 
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of uo (see Definition \5\ and Table [T] in Section [2]). But there is no Godel 
number for the function uj, which is computed by Q, because input-output 
pairs (l,ip(j)) and (x, c) may be added to the function a whenever Q is 
executed. 

Referring to his "Theorem 2.4, with its corollaries" Davis Il982aj pp. 
121-122] writes: 

... these results really constitute an abstract form of Godel's fa- 
mous incompleteness theorem ... they imply that an adequate 
development of the theory of natural numbers, within a logic L, 
to the point where membership in some given set Q of integers 
can be adequately dealt with within the logic ... is possible only if 
Q happens to be recursively enumerable. Hence, non-recursively 
enumerable sets can, at best, be dealt with in an incomplete man- 
ner. 

This implies that the function uo, which is computed by the procedure Q, 
cannot be dealt with within a logic, that is, a formal system because the 
range of uo is not recursively enumerable according to Theorem 

Let R be any Turing program that generates any sequence of Godel num- 
bers 

jl,j2,." (13) 

of Turing programs Pj 1 , Pj 2 , ... computing total functions whose range is a 
subset of {i\(fi total}, that is, R successively generates the Godel numbers 
ji, j 2 , ... in f fl3|) PI Rule [1] applies the procedure Q in Tabled] to any Godel 
number in f lT3"j) as soon as such a Godel number is generated. Rule [TJ also 
processes Godel numbers that are not generated by the Turing program R, 
that is, if the Godel number, say jk, of any Turing program Pj k computing 
a total function is generated whose range is a subset of the set {i\(pi total}, 
then Rule [1] applies the procedure Q in Table [1] to jk- Thus, according to 
Theorem in Section [2] there is no Godel number j\ such that Pj k computes 
the total function uo in Definition O 

If the Godel numbers j in the input of Rule [1] are restricted to the Godel 
numbers jx,j2, ••• i n ( fl3|) . which are generated by the Turing program R, the 
range of the total function uo in Theorem |5] is recursively enumerable. But 
such a restriction restricts the input of Rule [1] to a recursively enumerable 

2 The sequence of Godel numbers j\, j2, ■•• in Example [2] in Section [2] can be generated 
by such a Turing program R. 
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subset of the set total} and thus restricts the generality of Ruled] be- 
cause the set {i\ipi total} is productive. This means that the inputs of Rule 
[1] cannot be restricted to a recursively enumerable subset of {i\(fi total} be- 
cause a productive function ip for {i\{pitotal} could be applied to a Godel 
number j of a Turing program generating this subset and thus produce the 
Godel number ip{j) of a Turing-computable function that is contained in 
{i\<Pi total} but not in this subset. Thus, the range of the total function uj 
in Theorem [5] is not recursively enumerable because the inputs of Rule [1] 
cannot be restricted to a recursively enumerable subset of the productive set 
{i\(fi total}. 

Rogers |l987[ pp. 10-11] discusses "the problem of getting a satisfactory 
[formal] characterization of algorithm and algorithmic function" because the 
application of diagonalization to a list of total algorithmic functions yields a 
total algorithmic function that is not contained in the list (see the proof of 
Theorem [1] in Section [2]). Rogers jl987j pp. 11-12] writes: 

We can avoid the diagonalization difficulty by allowing sets of in- 
structions for nontotal partial functions as well as for total func- 
tions. ... The approach taken by way of partial functions is, 
in essence, the approach taken by Kleene Church Turing 
[1936] and others in the 1930's. 

Referring to "the concept of general recursiveness (or Turing's computabil- 
ity)" Godel [Tg5Bcl p. 84] writes: 

. . . with this concept one has for the first time succeeded in giving 
an absolute definition of an interesting epistemological notion, 
i.e., one not depending on the formalism chosen. In all other 
cases treated previously, such as demonstrability ... it is clear 
that the one obtained is not the one looked for. ... By a kind 
of miracle ... the diagonal procedure does not lead outside the 
defined notion. 

Thus, there is only a formal characterization of a single "interesting epis- 
temological notion", that is, the Turing-computable partial functions. In 
contrast, creative procedures provide a framework for an investigation of 
other "notions" such as Turing- computable total functions. This framework 
is not subject to a "diagonalization difficulty" but uses diagonalization to 
investigate such "notions" which cannot be captured by formal systems. 
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Discussing the formalization of a theory which results in a formal system, 
Kleene fl952[ p. 64] writes: 



Metamathematics must study the formal system as a system of 
symbols, etc. which are considered wholly objectively. This means 
simply that those symbols, etc. are themselves the ultimate ob- 
jects, and are not being used to refer to something other than 
themselves. The metamathematician looks at them, not through 
and beyond them; thus they are objects without interpretation 
or meaning. 

Referring to his undecidable formula A p (p) in Godel's incompleteness theo- 
rem Kleene [1952, p. 426] writes: 

... if we suppose the number-theoretic formal system to be con- 
sistent, we can recognize that A p (p) is true by taking into view 
the structure of that system as a whole, though we cannot recog- 
nize the truth of A p (p) by use only of the principles of inference 
formalized in that system, i.e. not h A p (p)|f| 

Thus, Godel's theorem requires a reference to the (incomplete) formal "sys- 
tem as a whole" which cannot be achieved within the formal system itself 
because, in our interpretation, the formal system cannot take "into view the 
structure of that system as a whole", that is, "wholly objectively". In par- 
ticular, a formal system represented by a Turing program cannot take "into 
view the structure of that" Turing program "as a whole", that is, "wholly 
objectively" , in the sense that the Turing program, which produces a (recur- 
sively enumerable) subset of a productive set, cannot refer to itself and thus 
capture the result of applying a productive partial function for the productive 
set to its own Godel number. 

The assumption that all reasoning processes can be modeled by a Turing 
program (see Section [T]) immediately yields a contradiction if the following 
if-then rule, which is also an implementation of the existence principle, is 
used: 

Rule 2. If j is the Godel number of a Turing program Pj that computes 
a total function whose range is a subset of {i\ipi total}, then if} (J), where if) 

3 The expression "not h A p (p)" in Kleene il952l means that the undecidable formula 
A p (p) in Godel's theorem is not provable in the formal system. 
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is a productive partial function for {i\(fi total}, is the Godel number of a 
Turing-computable total function, that is, y^vO) is a total function. 

Rule [2] is an immediate implication of Theorem [T] in Section [2J A pseudo-code 
for Rule M is 

if L(j) then T(i;(j)), (14) 

where L(j) is a formal proposition which stands for the condition "j is the 
Godel number of a Turing program Pj ... a subset of {i\ifi total}" in Rule 
[2J and T(j) is a formal proposition which stands for the consequent "V'O) 
... is the Godel number of a Turing-computable total function" in Rule [2J 
that is, L and T in fll4p refer to fixed finite strings. If we assume that all 
reasoning processes can be modeled by a Turing program, say Pk, then Pk 
computes a total function whose range is the subset of total} containing 
all members of {i\^Pi total} that are generated by Pk- Let j be the Godel 
number j of a Turing program Pj that computes this total function. The use 
of Rule[2J, which is an implementation of the existence principle, implies that 
a formal representation (THI) of Rule [2J and a formal representation L(t) of its 
condition are contained in the Turing program Pk which is assumed to model 
all reasoning processes. The application of (|T4j) to L(t) by the Turing program 
Pk yields the consequent T(ip(j)) in (THj) . Thus, we have a contradiction 
because, according to Theorem [T] in Section [2J is not contained in the 
range of (pj which contains all members of {i\<fi total} that are generated 
by Pk- These considerations also apply to the "reasoning processes" of a 
"machine" or "robot" because, as described above, the existence principle, 
in particular, Rules [T] and [2J can be implemented physically. 

As discussed above, a restriction of the input of Rule [T] to a recursively 
enumerable subset of {i\^Pi total} restricts the generality of Rule [TJ The 
use of Rule [2j which is an implementation of the existence principle, also 
implies that such a restriction restricts the generality of Rule [1] because the 
application of Rule [2J to the Godel number j of a Turing-computable total 
function whose range is the subset of {i\fitotal} yields the Godel number 
ip{j) of a Turing-computable total function that is not contained in this 
subset but satisfies the condition in Rule HJ A proof that j is the Godel 
number of a Turing-computable total function whose range is the subset of 
{i\<Pi total} can be extended to a proof that is the Godel number of a 
Turing-computable total function and not contained in this subset because 
ip is a productive partial function. 
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No formal system can capture its own existence in the sense that every 
Turing program representing a formal system and generating (recursively 
enumerable) subsets of productive sets cannot generate the result of apply- 
ing productive partial functions for the productive sets to the Godel numbers 
of Turing programs producing these subsets (see Theorem [1] in Section [2] and 
the quotation from Davis [I982al PP- 121-122] above). This implies that a 
Turing program generating a (recursively enumerable) subset of a productive 
set cannot contain a reference to its own Godel number because a productive 
function for the productive set could be applied to such a reference such that 
the original Turing program could contain the output of the productive func- 
tion. The incompleteness of formal systems is "overcome" by the existence 
principle which can be implemented in rules such as Rule [TJ Roughly speak- 
ing, this principle implies that existing information is provided in the input 
of creative procedures and thus "overcomes" the incompleteness of formal 
systems and the limits of Turing's computabilityjfl Thus, the second input 
variable j in the procedure Q in Table [1] is required because formal systems 
including Turing programs cannot refer to existing information such as their 
own Godel numbers. 



4 Related Work 

Church's jl965[ pp. 90, 100-102] thesis^] states that every effectively calculable 
function is general recursive, that is, computable by a Turing machine (see 
Kleene [T9521 pp. 300-301, 317-323]). Since "effective c alculab ility" is an 
intuitive concept, the thesis cannot be proved (see Kleene Il952[ p. 317])|§ 

Referring to Godel's Il965al incompleteness theorem and Church's [1965, 
pp. 90, 100-102] identification of effective calculability with recursiveness, 
Post I1965bl p. 291, footnote 8] writes: 

"Actually the work already done by Church and others carries this 
identification considerably beyond the working hypothesis stage. 

4 Post Il965a[ p. 423] writes: "What we must now do is to isolate the creative germ in 
the thinking process." 

5 The term Church's thesis is due to Kleene [19651 p. 274] (see Kleene fl952l pp. 300, 
317]). 

6 In his article "Why Godel Didn't Have Church's Thesis" Davis I1982bl p. 22, footnote 
26] writes: "We are not concerned here with attempts to distinguish 'mechanical proce- 
dures' (to which Church's thesis is held to apply) from a possible broader class of 'effective 
procedures' ..." 
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But to mask this identification under a definition hides the fact 
that a fundamental discovery in the limitations of the mathemati- 
cizing power of Homo Sapiens has been made and blinds us to 
the need of continual verification." 

Thus, Post calls for a "continual verification" of Church's thesis because of 
the incompleteness of formal systems (see Section [TJ . 

Referring to Principia Mathematica (see Godel Il965aj ) and his normal 
systems, Post |l965aj p. 408] writes (see Section [1]): 

... for full generality a complete analysis would have to be made 
of all possible ways in which the human mind could set up finite 
processes for generating sequences. 

In our view, the existence principle can be used by the "human mind" because 
existing information, for example, a Turing machine representing a formal 
system, must be a constituent of the "human mind", that is, a constituent 
of reasoning. Thus, the "human mind" can apply an implementation of the 
existence principle, for example, Rule HJ and the procedure Q in Table [I] in 
Section [2] to "set up finite processes for generating sequences" which cannot 
be computed by any Turing program according to Theorem [5j This means 
that a formal system cannot deal with a fundamental aspect of reasoning 
because it cannot refer to its own existence. 

The function u, which is computed by the procedure Q in Table [1] in 
Section [21 can be regarded as effectively calculable because the elementary 
operations of Q are Turing-computable according to Theorem [2] and Rule HJ 
which uses the procedure Q, can be implemented physically. 

The condition "if the procedure Q ..." in Theorem is satisfied if Rule 
[H in Section [3] is applied. Rule [I] is an implementation of the existence prin- 
ciple, which states that existing information, for example, Godel numbers 
of Turing-computable total functions whose range is a subset of all Turing- 
computable total functions, that is, recursively enumerable subsets of a pro- 
ductive set, is provided in the input of creative procedures which contain 
a productive function for the productive set. Thus, Church's thesis is not 
valid if the existence principle is applied to recursively enumerable subsets 
of productive sets and suitable procedures. 

Church [1965, pp. 90, 102] presents his thesis as a "definition of effective 
calculability" and proposes a second definition of effective calculability: 
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... (2) by defining a function F (of positive integers) to be ef- 
fectively calculable if, for every positive integer m, there exists a 
positive integer n such that F(m) = n is a provable theorem. 

If we require for every input j of the procedure Q in Table [T] a formal proof 
that the Turing program Pj computes a total function (see the modification 
of Rule[T] in Section [2]), then, for every natural number (positive integer) x 
in the input of Q, which computes the function oo(x), there exists a natural 
number y such that u(x) = y is a provable theorem in some formal system, 
say S x . Such a formal system also exists for any finite set of natural numbers 
x in the input of Q. But, because of Theorem in Section [21 there exists 
no formal system S such that u(x) = y, where y is a natural number, is 
a provable theorem in S for all natural numbers x0 Roughly speaking, 
Theorem [5] implies that the formal systems S x cannot be unified into a single 
formal system S. 

In a letter of June 8, 1937, to Pepis Church wrote (see Sieg jl997[ pp. 
175-176]): 

... if a numerical function / is effectively calculable then for every 
positive integer a there must exist a positive integer b such that 
a valid proof can be given of the proposition f(a) = b... 

Therefore to discover a function which was effectively calcula- 
ble but not general recursive would imply discovery of an ut- 
terly new principle of logic, not only never before formulated, 
but never before actually used in a mathematical proof - since all 
extant mathematics is formalizable within the system of Principia 
[Mathematica], or at least within one of its known extensions. 

As far as we know the existence principle was "never before actually used in 
a mathematical proof . 

The function a in the procedure Q in Definition [5] and Table [U which 
is represented as a set of input-output pairs, is a subset of the input-output 
pairs of the function lo. Q returns a(x) as the output of u(x) for any natural 
number x in the first input of Q, that is, the input of u. Nevertheless, 
the set a of input-output pairs, which is the empty set before the first 

7 Here, we implicitly assume that the formal system S is represented by a Turing ma- 
chine and a Gddel number for the recursively enumerable subset of total} produced 
by S is generated such that Theorem [5] and Rule Q] are applicable. 
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execution of Q, is finite at every point in time. Obviously, each set a of 
input-output pairs can be generated by a Turing machine. Thus, the number 
of states of Turing programs generating a is finite "at each stage" of its 
development but according to Theorem [5] there is no Godel number of a 
Turing program computing u, that is, a "at each stage" of its development 
(see Godel [19901, p. 306] and Section [TJ. This means that the number of 
states of the Turing machines generating a will not be "confused" by an 
"infinity of states of mind" because this number of states is finite "at each 
stage" of the development of a, that is, the development of u (see Turing 
[T9361 pp. 249-250] and Section QJ @ 

Referring to Church's thesis and Godel's "mental procedures" Kleene 
\WE7\ pp. 493, 494] writes: 

For, in the idea of "effective calculability" or of an "algorithm" 
as I understand it, it is essential that all of the infinitely many 
calculations ... are performable ... by following a set of instruc- 
tions fixed in advance of all the calculations. If the Turing ma- 
chine representation is used, this includes there being only a finite 
number of "internal machine configurations" , corresponding to a 
finite number of a human computer's mental states. ... As Turing 
... says "If we admitted an infinity of states of mind, some 
of them will be 'arbitrarily close' and will be confused." Hardly 
appropriate for keeping things straight digitally! 

... an effective (finitely describable) procedure from the begin- 
ning, coming under the Church- Turing thesis. 

In our view, the descriptions of the procedure Q in Section [2] and Rule [TJ in 
Section [3] are "fixed" at the beginning and "finite" at every point in time but 

8 We suppose Turing's 1936, pp. 249-250] infinity is an infinity according to a mathe- 
matical definition. For example, a definition states that a set is infinite if it is not finite. 
Another definition states that a set A is Dedekind-infinite if some proper subset B of A is 
cquinumerous to A, that is, there is a bijection (one-to-correspondence) between A and B. 
In Zermelo-Fraenkel set theory this definition is equivalent to the condition that a set A is 
infinite if there is a one-to-one correspondence between all natural numbers and a subset 
of A. The number of states of the Turing machines generating a is not finite and seems 
to be "unbounded" because there is no Turing machine generating a "at each stage" of 
its development if Rule [1] is applied. Hilbert 119831 pp. 183-186] writes: "... the infinite, 
as that concept is used in mathematics, has never been completely clarified ... the infinity 
in the sense of an infinite totality, where we still find it used in deductive methods, is an 
illusion. ... no other concept needs clarification more it does." 
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the function a in the procedure Q develops in the course of time because it 
depends on the input variables x and j of Q, that is, the functions a and u 
cannot be described "in advance" because the set of the Godel numbers of 
the Turing-computable total functions is productive. As described above, the 
number of states of Turing machines generating the function a will not be 
"confused" by an "infinity of states of mind" because this number of states 
is finite "at each stage" of the development of a, that is, the development of 
u (see Turing [T936I pp. 249-250] and Section!]). 

The proof of Theorem [1] in Section [2] states that the Godel number ijj(j) 
of the total function </V0') * s no ^ contained in the range of ipj, where j is any 
natural number such that tpj is a total function with range (pj C {i\(fi total}. 
In particular, the proof states that the total function v^vOO * s different from 
VtpAn) for all natural numbers n. This means that the productive function ip 
produces not only a new Godel number which is different from ipj(n) for 
all natural numbers n, but also a new total function (fMj) , which is different 
from all total functions (p v .(„) for all natural numbers n. 

Godel [TOT p. 306] writes (see Section HJ: 

... mind ... is not static, but constantly developing, ... 

If creative procedures and the existence principle are used, "mind" is "con- 
stantly developing" in the sense that it produces new structures from existing 
structures. For example, the use of Rule [JJ which is an implementation of 
the existence principle, produces a new Godel number in the creative 
procedure Q whenever any natural number j such that (pj is a total function 
with range (pj C {i\<fi total} is generated. As described above, y^vO') is a new 
total function which is different from all total functions ( P Vj (n) for all natural 
numbers nj^l 

9 All existing structures in a creative procedure are called "reflection base". The re- 
peated application of the existence principle, that is, the repeated application of a creative 
procedure to information in its reflection base, can be regarded as a feedback process which 
produces more and more powerful structures. A first step towards the implementation of 
a creative procedure is described in Ammon 1 19881 . Ammon Il992l . and Ammon [1993 . 
These experiments suggest that creative procedures are a self- developing process which 
can start from any universal programming language. Their structure can be regarded 
as a web of concepts and methods which are called "analytical spaces" and cannot be 
characterized formally. This is plausible because formal systems are restricted to Turing- 
computable partial functions, that is, recursively enumerable sets (see the quotations from 
Davis Il982al pp. 121-122], Rogers [15571 pp. 11-12], and Godel Il965cl p. 84] in Section©. 
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Lucas jl96lj argues that mind cannot be modeled by a Turing machine 
because he knows that the undecidable proposition in Godel's theorem is true 
(see Shapiro [19981 pp. 273-274]). Putnam points out that Lucas cannot prove 
the prerequisite of consistency in Godel's theorem (see Shapiro Il998[ pp. 282- 
284]). The procedure Q and Ruled] in Section [2] can be executed by a human 
and by a "machine" to compute the function u. According to Theorem 
there is no Turing machine computing oj. Thus, an implementation of the 
existence principle, which merely uses the existence of a formal system, that 
is, a Turing machine itself, "overcomes" its incompleteness, that is, the limits 
of the Turing machine 1^1 Referring to Penrose Il990l . Davis jl993[ p. 611] 
writes: 

However, it [Godel's theorem] is a quite ordinary sentence of el- 
ementary number theory and can be proved with no difficulty 
whatever in any formal system adequate for elementary number 
theory, such as for example Peano arithmetic. Note that this pow- 
erful form of Godel's theorem applies uniformly to any formalism 
whatever. 

Although Godel's theorem applies to any (given) "formalism"!"] and can be 
proved in a "formal system", no proof of Godel's theorem in any "formal 
system" can apply to this "formal system" itself because, as described above, 
no "formal system" can refer to itself, that is, to its own existence. Rather, 
a proof of Godel's theorem for a "formalism", that is, "formal system", say 
Si, requires another extended "formal system", say 5*2, which refers to Si, a 
proof of Godel's theorem for S2, requires another extended "formal system", 
say S3, which refers to S2, and so on0 Thus, there is no proof in any formal 

10 G6del 1965b, pp. 71-72] writes: "... due to A.M. Turing's work, a precise and unques- 
tionably adequate definition of the general concept of formal system can now be given, ... 
Turing's work gives an analysis of the concept of 'mechanical procedure' (alias 'algorithm' 
...). This concept is shown to be equivalent with that of a 'Turing machine'. A formal 
system can simply be defined to be any mechanical procedure for producing formulas, 
called provable formulas. 

11 Originally, Godel [l965al proved his theorem for the "formalism" of "Principia Math- 
ematica and related systems" . 

12 In particular, a reference to "any formalism whatever" cannot be formalized. For ex- 
ample, a Turing program generating a (recursively enumerable) subset of a productive set, 
is a "formalism" , that is, a formal system. A formal reference to all these Turing programs 
docs not exist because productive sets are not recursively enumerable. Mendelson Il964[ 
p. 253] writes that there are 2 N ° productive sets, that is, the cardinality of the productive 
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system showing that Godel's theorem applies "to any formalism whatever" . 
Therefore, the "insight" that Godel's theorem applies "to any formalism 
whatever" requires a new principle such as the existence principle which 
cannot be formalized although it can be implemented physically. 

5 Conclusion 

We described a procedure that computes a total function whose range can 
contain members of a productive set. The elementary operations of the pro- 
cedure are Turing-computable. We proved that there is no Turing program 
computing this total function if the existence principle is used which im- 
plies that existing recursively enumerable subsets of the productive set are 
provided in the second input of the procedure. The existence principle can 
be implemented in rules which can be executed by humans and "machines" . 
Roughly speaking, a formal system cannot contain a reference to itself and an 
extension of the recursively enumerable sets that it deals with by productive 
functions. In view of the existence principle, this means that a formal system 
cannot deal with a fundamental aspect of reasoning, that is, it cannot cap- 
ture its own existence. Church's thesis is not valid if the existence principle 
is applied to recursively enumerable subsets of productive sets and suitable 
procedures. We defined creative procedures which compute functions that 
are not computable by Turing machines and argued that creative procedures 
model an aspect of reasoning that cannot be modeled by Turing machines. 
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